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Abstract. 

We describe a general method to observationally exclude a theoretical model for 
gravitational wave (GW) emission from a transient astrophysical source (event) by 
using a null detection from a network of GW detectors. In the case of multiple 
astrophysical events with no GW detection, statements about individual events can 
be combined to increase the exclusion confidence. We frame and demonstrate the 
method using a population of hypothetical core collapse supernovae. 
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PACS numbers: 04.80.Nn, 07.05.Kf 

1. Introduction 

The global network of gravitational wave (GW) detectors [1] has yet to discover a signal, 
but their null detections have already constrained astrophysical models. Magnetar 
flares provide an example of such constraints. Satellite detectors observe unpredictable 
bursts of soft gamma-rays from neutron stars with extreme magnetic fields, known 
as magnetars. The hypothesis that a GW arrives within ±2s of such a gamma-ray 
burst was tested by looking for transient excess power in the GW data within this 
signal region, and comparing to the background [2]. There was no GW detection. The 
loudest transient event in the signal region was then compared to simulated GW signals 
predicted by models of the damping of non-radial global stellar modes, allowing the null 
detections to constrain these models. 

So long as the signal region duration tg is much less than the characteristic detector 
uptime timescale td, model exclusion from individual null detections can proceed as 
described above. However, when tg ^ t^ the situation is more complicated. In this case, 
the detectors may have outages during the signal region, and the data will have gaps. 
A short burst of signal falling a gap will be missed. 

Electromagnetically-triggered searches for GWs from core-collapse supernovae 
(CCSNe) are an example. A typical core collapse time estimated from optical light 
curves has a large uncertainty, and GW signal regions typically have durations lasting 
days or weeks. For example, SN2007gr was a promising supernova about 9 Mpc away. It 
was discovered on August 15, 2007, and the a pre-discovery empty image from August 
10 constrains the core-collapse time to an approximately five day region. On the other 
hand, the typical GW detector uptime timescale is only hours. Because ts ^ td, using 
a null detection from GW data to exclude SN models with a single CCSN event will be 
complicated by gaps in the data, and exclusion statements must be made with lowered 
confidence to reflect these observational gaps. This motivates the use of multiple CCSN 
events to improve the confidence of exclusion statements. 

In this paper we describe a simple and general method for quantifying the 
confidence of null-detection model exclusion statements given non- stationary detectors 
(or detector networks) and multiple observational events. We illustrate the method with 
a hypothetical search for GWs from CCSNe. 

2. Method 

2.1. Loudest event limits 

We begin by reviewing the frequentist loudest event limit construction, consistent with 
procedures described in [3] and used in astrophysical GW searches for burst-like signals 
such as [U [SI El Ej . Any physical observable which can be expressed as a monotonic 
function of the signal amplitude may be constrained; we refer to it as the observable 
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of interest. In the case of GW searches, the observable of interest is typically either 
root-sum-square GW strain at the detector (/irss) , GW emission energy -Egw; or source 
distance {d oc h~l). The signal is convoluted with the detector's response function and 
noises and may produce an "analysis event." In general an analysis event is anything 
interesting in the analyzed data, and could be a time- and frequency-limited burst of 
excess power, for example [7] . An analysis event in the signal region might correspond 
to either noise or a transient GW signal that is not strong enough to claim a detection. 
The analysis must define a ranking statistic with which to calculate the 'loudness' of 
analysis events. 

The general procedure for constructing an upper or lower limit is as follows: 

(1) Using the ranking statistic, estimate the loudness of the analysis events in the signal 
region. 

(2) For a class of signals predicted by the model of interest, add a simulated signal 
at a particular amplitude at a randomly selected time into the data. Analyze the 
data. If the chosen amplitude is large enough, the simulated signal will produce an 
analysis event with some measurable loudness. 

(3) Assign an analysis event to the simulated signal. To do this, find analysis 
events within a time At of the simulated signal's known placement, estimate their 
loudnesses, rank them, and choose the loudest. At is chosen to be as small as 
possible while not missing a significant fraction of loud, easily detectable signals [8] . 
The loudness of the analysis event corresponding to the recovered simulated signal 
will depend on local noise fluctuations, in addition to the amplitude of the simulated 
signal. 

(4) Repeat (l2j) and ([3]) for a range of signal amplitudes (which can be mapped to the 
physical observable of interest x) and at each value determine the fraction P{x) 
of added simulated signals with associated analysis events louder than the loudest 
signal region analysis event. 

(5) Repeat (jlj) using different simulated signal types representing different models as 
necessary. 

For a single signal region with 100% duty cycle, this procedure allows us to construct 
efficiency curves P{x) which give the probability that the signal producing a particular 
measurement of the observable of interest x will be louder than the loudest signal region 
event. An example is shown in Figure[Tl 

The conclusion we draw from P{x) depends on a particular model M. If M predicts 
the value of the observable of interest associated with the observational event, xm , then 
we can state the exclusion confidence P{xm)- This is shown by the vertical green line 
in Figuredl 

If M predicts a range in x, we may be able to exclude a region of model-space. We 
can find the 90% detection efficiency loudest event upper limit x^"^", which is the value 
of X at which 90% of analysis events associated with simulations predicted by M would 
be louder than the loudest signal region event. This results in the 90% confidence limit 
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Figure 1. Example efficiency curve for a Irypotlrctical null detection of an 
observational event, illustrating a model exclusion for a model predicting an observable 
of interest xm = 2 (green dash-dot line) and the construction for a 90% detection 
efficiency loudest event limit (red dashed lines, in this case, an upper limit) described in 
the text. This efficiency curve was constructed using a simple Monte Carlo simulating 
detector noise. In the absence of detector noise, the efficiency curve would be a step 
function. 

for the model M and the observational event, the red construction in FigureHJ We see 
that loud analysis events in the signal region diminish the excluding power of the data. 

2.2. Non- stationary detector observing one event 

We now discuss the case of one observational event with a model-predicted signal region 
covered by a non- stationary detector. A detector is non-stationary if its properties 
change over time. Here, we consider changes in detector sensitivity, or the detector 
turning on and off. A network of multiple detectors independently turning on and 
off can be thought of as a single non-stationary detector comprised of the individual 
instruments. 

An example of this scenario is shown in Figure[2l the signal region predicted by the 
model is shaded. Here, region 1 (the blue line) has a duration of the first 30% of the 
signal region. It is covered by a detector (or detector network) observing with a noise 
level of 1, which turns off at t = 0.3. In Region 2 (the red line), the detector turns back 
on at t = 0.5 but is now noisier, with a noise level of 2. Between these regions, 20% of 
the signal region occurs with no detector observing; the duty cycle over the signal region 
is 0.8. A signal may have occurred while no detector was observing, so we cannot use 



Excluding Source Models with Multiple Astrophysical Observations 



5 




0.4 0.6 
time (a.u.) 



Figure 2. Example of a signal region (shaded) covered by multiple stationary 
detectors. Region 1 (the blue line) has a duration of the first 30% of the signal region 
and is covered by a detector or detector network observing with a noise level of 1. 
Region 2 (the red line) has a duration of the last 50% of the signal region and is 
covered by a detector or detector network observing with a noise level of 2. Here 
a lower noise level corresponds to a higher sensitivity, as with GW strain (thus the 
detector covering region 2 is half as sensitive as the detector covering region 1). The 
overall duty cycle is 80%. We cannot exclude any model which predicts this signal 
region, as a signal may have occurred while no detector was observing. 



this event to absolutely exclude the model. 

This case can be analyzed in the same way as the simpler single detector, 100% duty 
cycle case introduced above: add simulated signals randomly into the entire signal region 
and construct the efficiency curve. The procedure requires no modification. Simulated 
signals which fall into regions where no detector is observing will, of course, not be 
detected, and will not be counted in the detected fraction of the efficiency curve. The 
resulting efficiency curve is shown in Figure[3l While in this example the detectors 
change discretely, the same procedure will also work in the case of continuously changing 
detectors. (In practice, GW detectors change continuously.) 

We assume a flat probability density function for the location of the observational 
event (for example, a CCSN) within this signal region. We can make an exclusion 
statement for a model M, which predicts a signal from the event with some specific value 
xm for the observable of interest (which could correspond to the CCSN GW strain, for 
example) following the procedure in Section [2?T| except in this case the efficiency curve 




Figure 3. Monte Carlo demonstration of efficiency curves corresponding to the 
example signal region shown in Figure[2] The black curve shows the efficiency curve 
for the total signal region; it achieves a maximum value 80% corresponding to the 
duty cycle of the signal region. The blue and red dashed curves are efficiency curves 
constructed in the blue and red portions of the signal region, respectively. The sum of 
these two curves equals the black curve. In region I the detector was more sensitive, 
and is able to sense signals corresponding to smaller values of x. 



will asymptote to the overal duty cycle P{x = oo) = 0.8. We could make a statement 
such as, "We exclude the model M with 80% exclusion confidence" if xm were greater 
than three, for example. With a single event this is the best we can do. For any value 
of Xm predicted by the model, we can find the corresponding fraction detected, which 
can be interpreted as the exclusion confidence. 

We note that the method can be generalized to the case where the probability 
density function for the event location with the signal region tg is assigned a non-fiat 
prior. In this case the time location for each simulated signal within the signal region is 
chosen randomly according to the prior PDF, whatever that may be. No other change 
is necessary. 

2.3. Multiple events 

Consider two independent but identical astrophysical events, occurring within distinct 
signal regions each with detector duty cycle of 0.5, neither of which is detected. The 
probability of missing detectable signals from both events is 1/4, and we can exclude 
the model M with up to 75% exclusion confidence. In general, for independent 
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observational events with duty cycles Cj (the fraction of the signal region observed by 
the detector for the zth event), the maximum exclusion confidence is 

N 

em,. = l-l[il-Ci). (1) 

i=l 

It is possible that some of the null detections from these observational events will 
not fully constrain the model, given the detector sensitivity. In this case, we construct 
the individual efficiency curves and find the values Pi{xM) for each observational event. 
Then the observational exclusion confidence is 

N 

e = i-Y[(l-P^la:M)). (2) 

i=l 

For example, consider a CCSN model Msn which predicts an energy of GW emission 
i?GW and a particular GW emission pattern during the CCSN event. We can constrain 
the model using observations from multiple CCSN events at known distances di. 

First, efficiency curves are constructed for the individual events, Pi{d). Here, the 
observable of interest is source distance, d, and the amplitudes of the simulations 
predicted by Mg^ are scaled according to the inverse of the hypothetical distance to 
the CCSN (we imagine letting the source distance vary). Then the known distance to 
the source di is drawn as a vertical line on the curve and the model exclusion confidence 
Pi{di) is read off from the y-axis. 

These Pi{di) are combined into the overall exclusion confidence, e: 

N 

, = l.^il.p^i^d,)) (3) 

To illustrate, we now construct a specific example involving GWs from CCSNe. 
The emitted energy in gravitational waves -Eqw from some GW signal is proportional 
to the square of the signal's root-sum-square-strain /i^gg and the square of the distance 
to the source d (by conservation of energy): 

In units where the proportionality becomes equality, consider three CCSN events, at 
distances of 1, 2 and 4 units with signal region duty cycles of 0.4, 0.5 and 0.6 respectively. 
Imagine a detector and loudest event combination which always yields a detection when 
the simulated signal /irss is > 1, and a model that emits nine units of GW energy which 
yields /irss = 1 at a distance of 3 units. 

The individual efficiency curves are constructed for each CCSN in FigureHl For 
illustrative purposes we have added some randomized uncertainty in each simulated 
signal's /irss to model detector noise, which is why the efficiency curves are not perfect 
step functions. The detector can detect GW signals out to a distance of 3 units, although 
in some cases noise fiuctuations will subtract from the signal while in others they will 
add to the signal. Given the noise level used here, the CCSN events at distances of 1 and 
2 units should be detected, and using Equation[3]the exclusion confidence for the model 
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Figure 4. Distance efficiency curves for three hypothetical CCSN events. The blue 
and red vertical lines at distances of 1 and 2 units cross their respective curves at 
detection probabilities of 0.4 and 0.5 respectively, while CCSN 3 at a distance of 4 
units is too far away to be detected. Equation[3] yields an exclusion confidence of 0.7. 



given the three CCSN events is 0.7. For simphcity, our example avoids the transition 
regions of the efficiency curves. However, Eq.[3]will work regardless of where the known 
distances fall within the efficiency curves. 

We are free to choose a different observable of interest for the same physical 
processes. In the example above we could equally well begin by constructing efficiency 
curves for the individual observational events using emitted GW energy, i?GW- These 
individual efficiency curves Pj(i?Gw) are combined into the total exclusion confidence 
curve, P(£'gw) via 

N 

PAEgw) = 1 - - ^*(^Gw)] (5) 

i=l 

Pr(-E'Gw) gives the exclusion confidence as a probability as a function of i^cw; 
which folds in the known distances df. 

Egw = ((W)' + (^-)') dt. (6) 

Then the energy predicted by the model M, Eq^^, is drawn as a vertical line on the 
curve and the total model exclusion confidence e is read off from the y-axis. 



Under this second approach, the individual efficiency curves look like Figure 5 (a 



The combined exclusion confidence curve looks like Figure 5(b) and once again yields 
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(b) 



Figure 5. (a) Individual GW emission energy (Eqw) efficiency curves for the 
example shown in FigurelH The red vertical line shows the actual i?GW predicted 
by the hypothetical model under examination, (b) Combined GW emission energy 
(i?Gw) efficiency curve for the example shown in Figure|4l The red vertical line at 
the predicted value -Eqw = 9 intersects the curve at an exclusion confidence of 0.7, as 
before. 



an exclusion confidence at nine units of energy of 0.7. The first two CCSN sliould be 
detected witli efficiencies given by the duty cycles, 0.4 and 0.5, while the third CCSN 
should not be detected and thus does not contribute to model exclusion. 
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3. Conclusion 

We have presented a method for estimating confidence levels for excluding theoretical 
models, given an observational result of null detections over multiple events. Our 
method can potentially increase the exclusion confidence in cases where the detector 
duty cycle does not completely cover the signal regions. This method could significantly 
improve the astrophysical potential of searches for gravitational waves from core collapse 
supernovae. 
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